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Abstract 

The theory of multiple-input multiple-output (MIMO) technology has been well-developed to increase fading 
channel capacity over single-input single-output (SISO) systems. This capacity gain can often be leveraged by 
utilizing channel state information at the transmitter and the receiver. Users make use of this channel state 
information for transmit signal adaptation. In this correspondence, we derive the capacity region for the MIMO 
multiple access channel (MIMO MAC) when partial channel state information is available at the transmitters, 
where we assume a synchronous MIMO multiuser uplink. The partial channel state information feedback has a 
cardinality constraint and is fed back from the basestation to the users using a limited rate feedback channel. 
Using this feedback information, we propose a finite codebook design method to maximize sum-rate. In this 
correspondence, the codebook is a set of transmit signal covariance matrices. We also derive the capacity region 
and codebook design methods in the case that the covariance matrix is rank-one (i.e., beamforming) . This is 
motivated by the fact that beamforming is optimal in certain conditions. The simulation results show that when 
the number of feedback bits increases, the capacity also increases. Even with a small number of feedback bits, 
the performance of the proposed system is close to an optimal solution with the full feedback. 

Index Terms-Limited feedback, MAC systems, MIMO systems, CSI at receiver (CSIR), CSI at transmitter 
(CSIT), Rayleigh channels, Grassmannian subspace packing 
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1 Introduction 

Multiple access systems are being widely studied to effectively support multiple users at the basestation during uplink 
transmission. In multiple- input multiple-output multiple access channels (MIMO MACs), it is known that the channel 
state information at the transmitters (CSIT) helps increase system performance (e.g., sum-rate capacity) regardless of 
whether it is perfect or partial [1-5]. CSIT can be full channel information [1—3], channel covariance information [4,5], 
channel mean information [4,5], etc. Especially in frequency division duplexing (FDD) systems, because channel 
state information (CSI) is not reciprocal between uplink channel and downlink channel, this information should be 
fed back from the receiver to the transmitters. In real communication systems, however, the feedback resources 
allotted for CSI feedback must be a small portion of the data being transmitted on the downlink because feedback 
bits are overhead that causes performance degradation. 

In this correspondence, we focus on limited feedback schemes, where the receiver is assumed to have perfect 
knowledge of the CSI and the receiver transmits a limited number of feedback bits to the transmitter according to 
the CSI. It is of our interest to optimize signal covariance matrices of each user using a limited number of feedback 
bits. The basestation and users are assumed to have knowledge of a codebook of covariance matrices designed offline. 
The limited number of feedback bits allows each user to identify the covariance matrix chosen by the basestation for 
them to use during transmission. 

The main contributions of this correspondence are given below: 

1) In MIMO systems, we prove the coding theorem for MACs when a limited number of feedback bits is available 
at the transmitters. Based on the proved coding theorem, we give a method to design a codebook (set of covariance 
matrices) for each user under a finite feedback cardinality constraint to maximize the sum-rate capacity. Assuming 
B bits of feedback, the basestation selects one codeword that maximizes the sum-rate among 2 B elements in a 
coodebook. This codebook is assumed to be known to both the basestation and the users. The index corresponding 
to the chosen codebook matrix is fed back to the users. 

2) In single user MIMO scenarios, beamforming is optimal under certain conditions [6-10] when feedback is 
channel mean or channel covariance information. In multiuser scenarios, beamforming is generally not universally 
optimal, i.e., the full capacity rate region cannot be achieved. However, if some criteria arc satisfied, the sum-rate is 
asymptotically achieved by beamforming. Studied in [11], the optimality of beamforming was derived when channel 
feedback is perfect. In [4,5], the optimality of beamforming was proved when feedback is channel covariance or 
channel mean information. Motivated by these works, we constrain the rank of each user's covariance matrix to 
one, i.e., each user performs beamforming on his/her own array. We derive the capacity region of the beamforming 
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system and propose two methods to design the bcamforming vectors: eigenbeamforming with a codebook designed 
using Lloyd's algorithm and Grassmannian subspace packing with random power allocation of each user. 

2 System Overview 

In this section, we introduce the system model under consideration. A typical MIMO MAC communication system 
is presented in Fig. 1. Let M t be the number of transmit antennas at each user and M r be the number of receive 
antennas. In this setup, the received signal is given by 
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where K is the number of users and G X Mt is the transmitted signal from the fc-th user with X denoting the 
transmit symbol alphabet. Here, n is the time index and N is the block length of each code = {x\, . . . ,Xn}- 
is the M r x M t channel matrix from the fc-th user to the basestation. z n is the complex Gaussian noise with 
zero mean and covariance a 2 1. Here we assume that data symbols of each user are independent of each other, i.e., 
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xl fe ' (xrP) = Om,xm„ Vfc 7^ I, where Om,xm, is M t x M t all zero matrix. We assume a Rayleigh flat fading 
environment, where the channel independently changes from transmission to transmission. We also assume that the 
channel state information U n &U and V n € V are available at the transmitters and the receiver, respectively, where 
U is the space of CSIT and V is the space of channel state information at the receiver (CSIR). CSIT U n is fed back to 
the transmitters based on the current CSIR V n . We assume that the channel coefficients are estimated perfectly at 
the receiver. Since the channel fading is assumed to be independent for each n, the transmitted symbol is a function 
of the feedback CSIT U n . We assume noiseless feedback, i.e., the users know U n perfectly. 

Message for user fc, fc = 1, . . . ,K, is encoded to for n = l,...,N depending on the feedback U n . 

These encoded signals are sent through the channel with channel transition probability p (y^lxi, , where 
Hi — {Hi, . . . ,H N } and y± = {y 1 , . . . ,y N }. After receiving y^, the receiver decodes to {W^\ . . . , W^). 
Assuming the discrete memoryless channel model, the system is characterized by the following channel transition 
probability 

N 

p(y?\x?,H* r ) = l[p(v n \x n ,H n ). (2) 

71=1 

This is illustrated in Fig. 2. 
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3 Capacity Results 



In this section, we give capacity results when complete CSIR and partial CSIT are available at the receiver and the 
transmitters, respectively. Partial CSIT is assumed to consist of feedback information from the basestation to the 



users. 



The system model of Fig. 2 can be transformed into an equivalent system without CSIR and CSIT [12-16] by 
seeing U n as a channel state and V n as a channel output. Similarly, in this multiple access system, we first encode 
each into the matrix T^ fc) e X Mt *M, n = 1, . . . , N, and select one column of according to the current 

feedback U n eM such that = (U n ). With the probability distribution function p(H n , u n , v n ), the equivalent 
channel is characterized by the channel transition probability [15] 



p(y m v n\T n ) — p(H n , u n , v n )p(y n \T n (U n ) , H n ) , 

u n ,H n 



(3) 



where T r , 



. Fig. 3 presents this equivalent system model. 
We assume that the CSIR includes both the CSIT component and the channel coefficient matrix, and the receiver 
feeds back the U n component of the CSIR to the transmitters. This means that the receive channel state information 
is given by V n = (H„, U n ) [16]. We assume the finite rate feedback satisfies \U\ — 2 B with U = {u^\ . . . , u^ 2 ^}. 
To derive the multiple access capacity region, let S = {k\, . . . , fcisi} Q {1, ■ • • , K} be a user subset. Each user 



covariance matrix is given by Q^ k \ll n ) = E 



x 



(fc) 



Ur, 



for 



1, . . . , N, k = 1, . . . , K, with the power 



constraint Tr (U)j < Pk for MU G U. This means that we do not allow the average sum transmit power 
conditioned on some feedback information to exceed Pk for any feedback possibility. In this setup, the capacity 
region is given by the following theorem. 

Theorem 1 For a fixed mapping from U to {<2 (fc) {U)}* ^ such that Tr (Q {k) (U)j < P k for k = 1,...,K, the 
capacity region is the K -dimensional polyhedron 



R : J2 R {k) < E v 



kes 



log 2 dot [ I + a- 2 ]T hWQ« (U) (H< fe )) ' 



kes 



,VS C {!,..., X} , 



(4) 



where R — [R (1 *> ■ ■ ■ R^Y' is the rate vector. Additionally, for individual power constraints Tr (U)j < P k 

for k = 1, . . . , K, the capacity region is given by 

Cmac(Pi,---,Pk) = CI ( |J 

^ {Q (k) (U)}^T r (QW(U))<P k 



R : ]T R {k) < E V 
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where CI denotes the convex closure operation. 



We prove this theorem in the Appendix A. 

Fig. [4] shows an example for the capacity regions of two user systems corresponding to U2 = {u^\ u^} and 
Ua = {yS 1 ' , «( 2 ' , vS 31 ' , u^ 4 ) } for fixed power allocation P\ and P 2 . The capacity region is a union of capacity pentagons 
for fixed covariance matrices that are given by (|4"|). 



Remark [17-19] With a sum power constraint Ylk=i — P> the ca P a city region is given by 

Cunion (P) = Cli (J C M A c (P U ...,P K ) 

\E^Pk<P 

using the duality between the MIMO MAC and MIMO BC (broadcasting channel). 

4 Codebook Design Procedure Under a Sum Power Constraint 
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In this section, we give a method to design a codebook in a finite rate feedback environment to maximize the sum-rate. 
The sum-rate can be represented as 



X> W < E V 
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H G H a 



(7) 



where H = [H^ • • • H^l , V q = P(H e and H = {7ii, . . . , 7i 2 B } is the partition on the channel matrix space 
H. We let Q q k) = Q {k) {u^) and Q q = diag (Qq^,- ■ ■ ,Q ( q K) ^ to simplify the notation, where «W is a realization of 
?7 and diag(-, ...,•) is a block diagonal operator. In this setup, the basestation can simply feed back the covariance 
index q £ {1, 2, . . . , 2 B } to notify which covariance matrix Q q should be used to maximize the achievable sum-rate. 
This means that we can convey this CSIT using a finite rate feedback channel that sends the same B bits of feedback 
to all users. 

We apply Lloyd's algorithm [20] to solve the maximization problem!*! Because the detailed procedure of Lloyd's 
algorithm is similar to [20], we only emphasize the difference. In the process of designing the codebook using Lloyd's 



algorithm, one of the steps is to solve the optimization problem 
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1 As described in [20], Lloyd's algorithm converges to local optimum. As in [20], to obtain a point close to the globally optimal point, 
we run the same algorithm several times with different initial test channels and initial codebooks. Among the local optimum points, we 
choose the best point that gives the best capacity value. 



for a fixed partition Ti — {7ii, . . . , 7i 2 B }- We illustrate the approximate procedure of solving this optimization 
problem. By the heuristic approximation of [20], 

f(Q q ) = E[\og 2 det(I + o- 2 llQ q Yl*)\YleH q ]V q (9) 

m log 2 det(/ + cr- 2 £;[H*H|HeH (3 ]Q g )7' (Z (10) 

= log 2 det(J + a- 2 ii 9 Q g )7> 9 (11) 

= log 2 det(/ + ( 7- 2 5 9 g g 5;)P 9 . (12) 



c(l) . q{K) 



where S q k) £ £ MtKxMt . Thus, the optimization 



Here R q = E [H*H|H e H q \ = S* q S q with S q 
problem becomes 

Q q = argmax log 2 det ( 1 + a" 2 ^S^Q^ (sfA j 7>„. (13) 

Q 9 :Tr(Q 9 )<-P V fc=l J 

Therefore, the sum power iterative waterfilling algorithm [2] can be applied to this kind of optimization problem by 
treating the locally averaged S q , . . . ,S q K ^ as the channel matrices. Solving for q — 1, ... ,2 s , we can obtain the 
codebook Q — . . . ,Q 2 b j. Note that (flU)) is an approximation of the optimal solution of the original problem. 

Remark In a typical MAC system, a suboptimal solution can be found using individual power constraints. Indeed, 
the sum-rate maximization problem under individual power constraints is a special case of the sum-rate maximization 
problem under the sum power constraint. We can also apply Lloyd's algorithm to design a codebook under individual 
power constraints. An intermediate step in applying Lloyd's algorithm is to solve the optimization problem 

K 



(1) ~(K) 

Qc, ■ ■ Q q = argmax E 



{Qi k) y k = i :Tr(Q^)<P, 

The same procedure as the sum power constraint case gives 



log 2 det 7 + a- 2 ]TH«Qf(H«y 



fc=i 



H e H q 



(14) 



Q q ,---,Q q ) = argmax log 2 det I + o- 2 V Q q k) (S q k) ) )V q , (15) 



fc=i 



and this problem can be solved by the individual power iterative waterfilling algorithm [1] with the effective channels 

O(l) q(K) 

5 Limited Feedback MAC Beamforming 

In this section, we consider beamforming transmission for each user. We obtain the capacity region and derive 
codebook design methods for the limited feedback environment. 
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5.1 Capacity Analysis 



In the beamforming transmission, the received signal is given by 



fc=l 



(1) (1) 

(2) (2) 
Wn %n 



+ z n ,n = l,...,N, 



(16) 



where w^ e C Mt is the beamforming vector of the fc-th users. We assume that E 

2 



„(fc) 



1, which means that 



the transmission power of the system is given by J2k=i 



w 



(k) 



In the limited feedback system with B bits of feedback, the codebook is given by W = {w\, . . . ,w 2 b}, where 



w 



(««) T ...(»W) C 



Based on the current feedback u^, the beamforming vector is selected by w(u^) 



w q for some 1 < q < 2 B . The capacity region in the limited feedback system is given in the following corollary. 

Corollary 1 For sum power constraint Yl?k=i Pk < P with ||ti;( fe )(u^)|| < Pk for k = 1, . . . , K, the capacity region 
subject to a beamforming constraint is 

( ( 

u 

K {wW(u(«))}^ q=i ]\w^){uM)\\ 2 <P k 

log 2 det (i + a- 2 J2 H< fe V fe ) (U) (w^ (C/)) * (h« 



tbeam forming / p\ /^i 
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U « 
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J 



(17) 



The proof immediately follows from Theorem 1 . 

5.2 Eigenbeamforming with Lloyd's Algorithm 

In this section, we derive the beamforming codebook design method using eigenbeamforming with Lloyd's algorithm. 
As in Section 4, the sum-rate can be represented as 

log 2 det (l + o-- 2 Y^\l^w^ («,(*))* ( H «y 

V k=l 

We also let w q k ^ = w^ k \u^) for the notational simplicity. 

We can also apply Lloyd's algorithm to solve this kind of problem [20]. Similar to Section 4, in the process of 
solving for the codebook using Lloyd's algorithm, one of the steps is to solve 
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w q — argmax E 



w Q :\\w a V<P 



log 2 det (i + o-- 2 y H« W « («,<*>) * (H«) ' 
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This is not a convex optimization problem and is therefore difficult to solve. Thus we approximate this problem by 
using a lower bound and employing the heuristic approximation from [20] . 
First, we claim that 

-2 ^ 



log 2 det f/ + a- 2 f;H«<) (<>)* (#))'] > log 2 (l + («,«)* (h«)* H «<A . 
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for 1 < I < K because log 2 det(-) is monotonically increasing in the semi-definite cone. Because log 2 is monotonically 



increasing function, it is satisfied that 
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Adding (j2Tj) to both sides for 1 < / < K and dividing by K results in 

k \ r 2 
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Then by the heuristic approximation of [20], 

/K) > S log 2 ^l + ^^(<))*(HW)*HWi/;( fc )^ |HGW g 

« i og2 + 5" E H fc) ) * s [( H(fc) ) * H(fc) l H e W J «? } ) ^ 



9 " 



(21) 

(22) 

(23) 
(24) 
(25) 



fc=i 



where J?i fc) = £ 
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Instead of maximizing f(w q ), we utilize the lower bound g{w q ) because it is easier to obtain an analytical solution. 



Let w'^a^fUfeC*', 



where a 



(k) 



Wq\\ and \\vq k ^ 



1. Then 



9 



(26) 



We can select as the unit-norm eigenvector associated with the maximum eig envalue of R)^> . Then 



(fc) 



(27) 



where ^Ag fe ^ is the maximum eigenvalue of Rg k \ By the Schwartz inequality, 
g(w q ) < log 2 ( 1 + 



K 



\ k=l v 7 \ k=l 

Equality holds if and only if 

(<4*>) 2 = a(A(*>) 2 (29) 
for some positive constant a. Since EtLi ( a 9^) = ^> 



E (4 fe) ) • (28) 



p 



(a? } )' 

Therefore 

v (fe) _ VPAf ) 



(30) 



aW = — ' (31) 



and 



«« = ^2 <), (32) 

where ^Aq fe ^ is the maximum eigenvalue of i?^ and is the corresponding unit-norm eigenvector. 

The proposed method can additionally be validated by the papers [4,5,9], which state that when the covariance 
feedback is available at the transmitters the optimum beamforming vectors can be found as the eigenvector associated 
with the maximum eigenvalue of the covariance channel matrix of each user. 

5.3 Grassmannian Design 

In this section, we develop the Granssmannian codebook by solving the Grassmannian subspace packing problem [21] 
with random power allocation. References [22-25] dealt with a random beamforming codebook by employing random 
vector quantization (RVQ) in single user systems. This is based on the idea that the right singular vector of the 
channel which maximizes the capacity is random and isotropically distributed [24] under the assumption of an 
independent and identically distributed (i.i.d.) complex Gaussian channel matrix. In the same sense, in the MAC 
beamforming problem, each user's channel is i.i.d., and therefore we can assume that the power allocation of each 
user is randomly distributed according to sum power constraint. In this correspondence, the beamforming direction 
of each user will be generated in the Grassmannian sense [21]. The codebook design procedure will be described in 
the following. 
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5.3.1 Codebook design 



Let W = {w i , . . . , w 2 b } be the beamforming codebook, where w q 



K } ) T ••• K°) : 



constraint is given by ||tt>g|| 2 < P for = 1, . . . , 2 s . Then the sum-rate capacity is 



r^bearnf orrning 
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H,W 
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Here the sum power 



(33) 



where 



^0 



«4 X) Mt 
Mt w q 2) 



0m 4 
0m 4 







«', 



(«■) 



(34) 



is a beamforming matrix obtained by augmenting with each user's beamforming vector with the zero column vector 
of length M t , 0m ± - We can see that (|3"3"f is the capacity formula for the single user MIMO system with the covariance 
matrix W^gW* of the constraint that W q is block diagonal when {Wi, . . . ,W 2 b} is a codebook. Note that W q £ 
(£M t KxK or thogonal columns, but it is not unitary because W*W ^ al, where a is some non-negative constant 
chosen according to sum power constraint. In the unitary case of single user MIMO systems, references [22, 24] 
designed random codebooks by RVQ and reference [21] designed Grassmannian codebooks by Grassmannian subspace 
packing with the Fubini-Study distance. However, these codebook design methods are not directly applicable to our 
problem because our augmented beamforming matrix is not unitary. 

In this section, we will assume that w q k ^ = a q V q k \ where a q k ^ is the power allocation factor for the user k and 



v q k ^ is the normalized unit-norm beamforming vector for the user k. Here we assume that Ylk=i 
power constraint P. The augmented beamforming matrix is given by 



(fe) 
a q 



P for sum 



W q =B q V q , 



where B q — A q ® I with A q = diag (^cxip 



, ai K ^ ) and 



v [ q ] Mt 
Mt v[ 2) 



(35) 
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(36) 
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To maximize the sum-rate, it suffices to maximize the average determinant 

K 

/-ibearn f ' or rain q • t? 
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max det (I + <j 2 HB„V Q V*B*H*) 



max det (I + a- 2 U A V„V*U* A ) 



(37) 



where = means the equivalence of the optimization and = HB q . Thus, the codebook design problem can be 
viewed as the unitary codebook design of V = {Vi, . . . , V 2 b} with the equivalent channel Ha [21]. This problem can 
be solved by Grassmannian subspace packing using the Fubini- Study distance. The Fubini-Study distance is given 
by [21] 



d FS {V q ,V r ) = arccos|det(F:V r )| 



arccosfn | 



\k=i 



(38) 



Let <5ps(V) = min dps(V q ,V r ). By [21], the codebook V can be constructed by maximizing the minimum 

l<q<r<2 B 

distance <$fs(V). A detailed procedure to maximize 6fs(V) is given in the Appendix B using Lloyd's algorithm. B q 
can be randomly generated according to the sum power constraint, and the final beamforming vector can be obtained 



u ( fe ) 
by w q 



a.a Va , k — 1,...,K, q — 1, . . . , 2 B . The codebook can be constructed as W = {tOi, • • • ,w 2 b}, where 



w a = 



T 



5.3.2 Codebook Design in Correlated Fading 

In this section, we discuss how the codebook design can be modified for a correlated fading channel. We assume that 
the receiver experiences an uncorrelated fading environment [4,5]. Under a Kronecker correlated channel model, the 
general channel model of the user k is given by [4,5,26-28] 



(39) 



(k) Ik) 

where R\ is covariance matrix of transmit antennas for user k. The M r x M t random matrix H.^' is i.i.d. circular 
symmetric complex Gaussian with zero-mean and unit- variance. 

In this channel correlation environment, the statistical beamforming is introduced to achieve the sum-rate capacity 
[4,5]. The statistical beamforming matrix under the assumption that equal power is allocated for each user is given 
by [4,5] 



u stat 

0m 4 



>M t 



0M t 

(2) 



V 



stat 



0M t 

(K) 
V stat 



(40) 
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where v stat is the eigenvector associated with the maximum eigenvalue of R t . The statistical beamforming ap- 
proach considered in [4, 5] has excellent performance in highly correlated channel, but suffers when correlation is 
moderate. We can improve the sum-rate performance of statistical beamforming in a limited feedback scenario 
by leveraging a modified codebook design [29]. This follows from the fact that the minimum distance of the 
codebook V = {Vi, . . . , V 2 b} from Lloyd's algorithm is the same as the the minimum distance of the codebook 
V = {UVi, . . . , UV 2 b}, where U is an arbitrary unitary matrix. We can design our codebook such that V s tat = UV \ 
and the corresponding codebook is V = {UVi, . . . , UV 2 b}. 

In highly correlated channel environments, the proposed rotated codebook in the limited feedback environment 
has similar performance to the statistical beamforming. However, in moderate correlated channel environment, the 
proposed codebook has the better sum-rate performance than the statistical beamforming. We will see this increase 
of sum-rate in the numerical simulation section. 

6 Numerical Simulation 

In this section, we present numerical simulation results that show the sum-rate capacity performance of the proposed 
codebooks using Monte Carlo simulations. We call the multiple access system that has K users, Mt transmit 
antennas, and M r receive antennas a (K, M t , M r ) system. 
Covariance Codebook 

In this correspondence, we will compare the performance of the proposed system against a system with full CSI 
feedback and a system with no feedback. By no feedback, we mean that we allocate some scaled identity matrix 
to each data covariance matrix according to the power constraint. By full CSI feedback, we mean that we use the 
well-known iterative waterfilling [2] under a sum power constraint when the channel state information is known 
perfectly at all transmitters. 

Fig. [5] shows the simulation result for a (2,2,4) system under sum power constraint. The upper bound is the 
sum-rate performance when the users know the full CSI. The lower bound is the sum-rate performance when the 
users have no knowledge of the CSI. As we can see in this figure, as the number of feedback bits increases, the 
sum-rate capacity gain is also increased. 

Beamforming Codebook 

We show the performance of the eigenbeamforming with Lloyd's algorithm and the Grassmannian codebook with 
random power allocation. For the Grassmannian packing, to compare the performance, we simulated the random 
codebook with random power allocation. 
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First, we show the performance of eigenbeamforming with Lloyd's algorithm under sum power constraint. We 
simulated the system assuming each user receives 1 to 4 feedback bits to identify its beamforming vector. Fig. 
[6] shows the performance of the proposed eigenbeamforming of a (5,3,3) system. As the number of feedback bits 
increases, the sum-rate capacity also increases. Using 4 bits instead of 1 bit provides around a 1 dB gain. Compared 
to no feedback system, using 4 bits provides around a 2 dB SNR gain. 

Fig. [7] shows the sum-rate performance of the Grassmannian codebook and the random codebook for a (2,2,3) 
system. From the figure, we can see that the two beamforming methods work well. Using 3 bits instead of 1 bit 
provides around a 1.5 dB SNR gain. We can also see that the sum-rate performance of the Grassmannian codebook 
is better than that of the random codebook. This is because the minimum distance of the Grassmannian codebook 
is larger than that of the random codebook. We can expect that the larger the minimum distance, the higher the 
obtained performance gain. 

Fig. [5] shows the sum-rate performance of our Grasmannian codebook and statistical beamforming in correlated 
channel for a (2,2,3) system. We used the correlated channel model such that the eigenvalues of Rt are made be 
1.2 and 0.8 for each user. We can see that using 3 bit feedback information instead of statistical beamforming has 
an SNR advantage of around 1.5 dB. Note that the performance gain would be reduced if the transmitter spatial 
correlation increased. 

Fig. [5] shows the relative performance comparison between the covariance codebook, the eigenbeamforming 
codebook and the Grassmannian beamforming codebook for a (2,2,4) system with 2 bit feedback. The performance 
of the full CSI is included as a reference. As expected, the covariance codebook has the best performance of all the 
codebook schemes and especially at high SNR the performance is close to the optimal iterative waterfilling solution 
which has the same slope of increasing according to SNR. Also for the beamforming schemes, as expected we do not 
have a multiplexing gain compared to the covariance codebook. 

Fig. [10] shows the performance between the covariance codebook and time-division multiple access (TDMA) for 
a (2,2,4) system with 2 bit feedback. We can see that the proposed covariance codebook has similar performance 
compared to the TDMA scheme at low SNR. However, at high SNR, the performance gap becomes large. The second 
figure shows the ratio defined in [30, eq. (8)] between the covariance codebook and TDMA scheme. We can also 
verify the performance increases at high SNR. We can also observe the same performance trend as [30, Fig. 3] 
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7 Conclusion 

In this correspondence, we proved a coding theorem for the MIMO MAC with finite cardinality feedback and proposed 
a codebook (a set of covariance matrices) design algorithm with the spatial waterfilling design using Lloyd's algorithm. 
Compared to a no feedback system, a performance enhancement is observed even for a small number of feedback bits. 
Compared to full feedback, the proposed covariance codebook achieves comparable performance. We also derived the 
capacity region and two codebook design methods based on eigenbeamforming and Grassmannian subspace packing 
when we use beamforming for each user. Simulation results show that we can achieve more sum-rate capacity 
gains compared to the random beamforming codebook. Also for correlated channels, the proposed Grassmannian 
beamforming system has better sum-rate performance than the statistical beamforming codebook. 

Appendix A: Proof of Theorem [I] 

We will prove this theorem in several steps. 

T 



Lemma 1 Let X n («S) = 



1 T 



with S = {fci, . . . , fc|s|} C {1, . . . , K}. x n (S c ) can be defined 



in the same way with S . Then 

l(x n (S);y n \V n ,x n (S c )) < E Vn 

Proof 



log 2 det (i + a-^^Q^iUn) (H«) : 



kes 



EE C(S). 



(41) 



j(x„(<S);y n |14,x„(<S c )) = h (y n \V n , x„ (S c )) - h (y„|x„ (S) , V n , x„ (S c )) 

= h(y n \V n ,x n (S c ))-h{z n ) 

< E Vn [log 2 det (/ + a- 2 E [H„ (S) x„ (S) < (S) H* n (S) \V n })] 



where H„ (S) 



H 



(fei 



H„ 



Ex 



Ev n 



and E 



log 2 det 7 + a- 2 J2 [x« (x( fc )) \U, 

\ kes 

log 2 dct fj + ,-^H«QW (U n ) ( H W) 
l fc) (x^)> ; 



H ( fe : 



(42) 



(43) 



kes 

Q {k) (U n ). In dH, we use the maximum entropy 



property because the covariance matrix of y n given V n and x rl (5 ) is E [H„ (S) x„ (S) x* (S) H* (5) |I4] + o I [16] 



Lemma 2 Let T 

same way. Then 



and T(5) 



("T( fc i)) J 



H>(*|S|) 



/ (T (S) ; T (S c ) \y, V) = I (x (5) ; x (S c ) |y, V) 



T(5 C ') is defined in the 



(44) 
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T 

7 / , , , \ ' 

Proof We know that TW 



t (fc) _ _ _ t (fc) 



J l "\u\ 



(tf») 



where t\ k) £ X Mt . t 3 {S) is defined as t,- (S) 
i.e. the j-th column of T(<S). tj(«S ) is defined by the same way. We define a function / : U — > {1, . . . , |W|}, where 
/ (U) is a bijection. We also define T (S, U) = tf(m (5) and 

T (5, C/ c ) = [tx (5) • ■ ■ t /(t0 _! (5) t /(l0+1 (5) • ■ • t| M , (5)] . (45) 

T (<S C , £/) and T (S c \ U c ) can be defined in the same way. 
Then 

/ (T (S) ; T (S c ) \y, V) = I (T (5, C/ c ) , T (S, U) ; T U c ) , T t7) |y, V) (46) 
= /(T(5 c ',C/);T(5,[/)|y,y) 
+ / (T (S c , U) ; T (5, U c ) |T (5, C/) , y, V) 
+ 1 (T (S c , C/ c ) ; T (5, [/) |T (S c , C/) , y, V) 
+ I (T (S c , C/ c ) ; T (5, U c ) |T (S c , [/) , T (S, U) , y, V) 
= l(T(S c 1 U):T(S 1 U)\y,V) (47) 
= 7(x(S);x(S c ')|y,^). (48) 

Eqn. (|4"7) follows from independence of data for the set 5 and S c according to U and U c . Eqn. (|48p follows from 
x(5) = T (5, 17) and x(5 c ) = T (S c , 17). Here, we used 7 (A, 5; C,D) = I (D; B) + I (D; A\B) + I (C; B\D) + 
I (C; A\D, B). This can easily be seen by the chain rule. | 

Now we prove Theorem [TJ 
Proof We first prove (j4]). 

Achiev •ability: We follow the procedure of [31] with the equivalent channel in Fig. 3. 

Codebook generation: Fix p (t^\ ... ,T^J = FJfcLi P (t^^J . We generate 2 NR(k> independent codewords 
{ T « (w«) }f , W « € {l, 2, . . . , 2"« W } with respect to n£= x P where 

| T (fe) («(*>)}" = {if > , . . . , < fe) (>') } . (49) 

These codewords form the codebook, which is revealed to the transmitters and the receiver. 

Encoding: To send index uj^ k \ sender k sends the codeword (o>( fe )) , . . . , through the equivalent 

channel p(yf , uf |Tf ). 
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Decoding: Let denote the set of typical ^|t^| , ...,|t^| ,Vi 7 Vi^J sequences. The properties of 



Al ' are given in [31]. The receiver chooses the if -tuple (a/ 1 ), . . . , uj( k ^ such that 



{T« ( W W) }",..., {TW (*<*>) }; , , < J € Af) 

if such a if -tuple (a/ 1 ), . . . , u/*^) exists and is unique; otherwise, an error is declared. 

Analysis of the probability error: We can assume that (a/ 1 ), . . . , w'^) = (1, . . . , 1). We have an error if cither 
the correct codewords are not typical with the received sequence or there is a pair of incorrect codewords that are 
typical with the received sequence. Define the events 



N 



(50) 



E,„a 



wt 1 ),...,^) 



and 



^ fe) - {{ T(fe) (Djr : | Tr E'SU 1 ) - * 



(51) 



(52) 



for ?/„ e W. Then 



P 



V 



U4 fe) WwU[ U 



A' 



(5)^(1, ...,1), W (5C)=(1,...,1)J 

SC{1,...,A-} 



(53) 



fc=i 



where w(<S) = We can prove that P (E^ ,i) < e by the property of e- typical sequence. We can 

also prove that P (-Eq^) — 6 by the law of large numbers. If we define 

Tf (S,^ fe i\ . . . ,J k ^)) = j{T( fel )(^>)}" , . . . , {t(*i«") (c> s '))}^} , 



(54) 



then 



P E 



y w(5)=^( fe i),...^( fe i s i)^(5 c ')=(i,...4) y 
= P (( T f (5, . . . , J k ^)) , Tf 1, . . . , 1) , yf , V^) G 

({TW};,...,{Tm}f< ; <)e4 sl 

< |A( JV )|2" Ar(/l(T( ' 5)) " e) 2" Ar (' l ( T (' 5C )' y ' y )~ e ) 

< 2 7V(/ l (T(5),T(5 c ),y,y)+e) 2 -Ar(ft(T(5))- e ) 2 -A r ('i(T(5 c ),y,y)- e ) 
_ 2-A r ('i(T(5))+ft(T(5 c ),y,y)-/i(T(5),T(5 c ),y,y)-3e) 

= 2 -AT(/(T(5);T(5 c ),y,y)-3e) 
= 2 -Ar(/(T(5);y|T(5 c ),y)-3e) ; 



(55) 
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where Tf («S) = {Ti(«S), . . . , TV(<S)}. The last equality follows from 

I (T (S) ; T (S c ) , y, V) = I (T (S) ; T (S c ) , V) + 1 (T (5) ; y|T (S c ) , 7) (56) 

and 7 (T (S) ; T , V) = since T (5) and T (5 C ) are independent. 
Therefore 

< (K + l)e+ 2 N ( R ^- I ( T ^^ T ( sC )' V ) +3e ), (57) 

5C{l,...,if} 



where R (S) = J2 R{k) - Therefore, if R (S) < I (T (S) ; y|T (S c ) , V) , P { e N) -► as iV 
fees 



(JV) 

To complete the proof, it suffices to show that 

/ (T (S) ; y|T (S c ) , V) < I (x (S) ; y|x (S c ) , V) . (58) 

This is because 

l(T(S);y\T(S c ),V) 
= I (T (S) ; y| V) - J (T (5) ; T (S c ) \V) + I (T (5) ; T |y, V) 
= / (T (5) ; y\V) + I (T (5) ; T (S c ) |y, V) 

< 7 (x (5) ; y|V0 + 7 (x (5) ; x (S c ) |y, V) (59) 
= / (x (S) ;y| V) - I (x (5) ; x (S c ) |V) + 7 (x (5) ; x (S c ) |y, V) (60) 
= /(x(5);y|x(5 c ),y). (61) 
We also used the fact that 

I (A; B\C, D)=I (A; B\D) - I {A; C\D) + I (A; C\B, D) (62) 

and 7 (T (S) ; T (S c ) \V) — since T (S) and T (S c ) are independent. Eqn. (|S"9")) follows from the data processing 
inequality. We proved that 7 (T (S) ; T (S c ) \y, V) = I (x (5) ; x |y, 7) by Lemma H 

Therefore 7 (T (5) ; y|T (S c ) ,V) < I (x (5) ; y|x (S c ) , V) and the theorem follows. 

Converse Proof: We now prove the converse theorem. 
Let e {l,...,2 NR(h) X be a random variable, where k G {1, . . . , if}. Then, 

7V77(S) = 

= ff(W(S)|yW)+J(W(S);yf,t^) 

< H (WW, . . . , W^|yf , V?) + I (W (S) ; yf , V?) 

< l + NRPW+i(w(s);y?,VF) (63) 
= l + NRPW + i(w(S);y?\Vf), (64) 
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where R = J2k=i R(k) and w ( S ) = {W (kl \ . . . , W^Vl)}. Eqn. ||B3J) follows from Fano's inequality and flMJ) follows 
from the independence between W (S) and V n . 
j(W(5);yf is given by 



A' 



7(^(5);yfK) = £ I (W (S) ^l^y?" 1 ) (65) 
n=l 
AT 

< ^/(T^^jyJ^^r 1 ) (66) 

n=l 

AT 

= ^ [ft (T n (5) l^y?- 1 ) - ft (T n (S) |t^,y?)] 

n=l 
iV 

= ^[ft(T n (5)|K)-ft(T„(<S)|K,y„)] (67) 

n=l 

AT 

< ^[ft(T n (<S)|K,T n (<S c )) -ft(T n (<S)|y n ,K,T„(5 c ))] (68) 
n=l 

AT 

= ^7(T n (5);y„|K,T n (5 c )). 



Eqn. (|65p follows from the chain rule, and (|66[) follows from the data processing inequality. Eqn. (|6T[) follows from 
the fact that T„ (<S) is independent of the other variables except for y„, and (|6"8"1) follows from the fact that the 
condition does not increase entropy and T„ (S) and T„ (5 C ) are independent. 

We showed that I (T„ (S) ; y„|T„ (5 C ) ,V n ) < I (x n (5) ; y|x„ (5 C ) , K), and therefore, 

R(S)<±+RPW + C {S). (69) 

If P e (Af) -> as JV -> oo, then R(S) <C (S). 

Now we prove ([5]). By [28], the capacity of any MAC can be written as the convex closure of the union of 
rate regions corresponding to the input product distribution satisfying the individual power constraint. Therefore 
to obtain the capacity region of our MIMO MAC, we can unionize all capacity polyhedrons about all covariance 
matrices satisfying the power constraint and take the convex closure. For a fixed set of covariance matrices, the 
capacity polyhedron is given by The capacity region must be closed by Theorem 3 in [32]. We can show that 
this fixed capacity polyhedron is closed and that the union of these polyhedrons is also closed. This completes the 
proof. | 

Appendix B: Lloyd's Algorithm 

We give Lloyd's algorithm to find the codebook that maximizes the minimum distance. The Grassmannian line 
packing problem approximately solved using Lloyd's algorithm for single user MIMO beamforming systems has been 
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studied in [33,34]. Based on the Fubini- Study distance, we define the distortion measure 



di (G, V q ) = arccos(| det (G*V q ) 



ql \)i 



(70) 



where 



G 



g (1) Mt 
Mt g (2) 



0m 4 
0m 4 



(71) 



o A/t o Mt ••• g w 

and each g( fc ) € C Mt is a unit-norm vector. To find an optimal codebook, we should solve the following optimization 



problem 



V = aigmin.EG [di (G,V(G))] 



(72) 



where V(G) = argmindi (G,V g ), V q 6 V, and V' is a codebook of cardinality 2 s . The optimization problem of 

l<q<2 B 

d72l is difficult to solve because of the arccos function. Instead we define a modified distortion measure 



d 2 (G,v 9 )=-n (<<>)>> (g<*>)%(' 



(fc) 



(73) 



k=l 



which is mathematically tractable to solve analytically. This is because (f72"j) becomes 



V = argmin £ G [arccos (| det (G*V(G)) 

v 



= argmin^c [-| det (G*V(G)) | ] 
v 

= argmin^c H det (G*V(G)) | 2 ] 

v 



(74) 



argmin Eg 
v 



A' 



n (« ( *>(g«)) g (fc) ( g (fe) ) ^ } (g (fc) ) , (75) 
/c=i 

where v ( fc )(g( fe )) is the fc-th column of V(G). GU) follows from the fact that < | det (G*V(G)) | < 1 and arccos(-) 
is a monotonically decreasing function on [0, 1]. Optimization of ((75|) is also easier than the optimization of (|72|) to 
obtain the analytical solution. 

To minimize the average distortion, we apply Lloyd's algorithm. An intermediate step in applying Lloyd's 
algorithm is to solve the optimization problem 

V = argmmE G [d 2 (G,V)} 
v 



argmin Eg 
v 



,(fe) 



JI g( fc) (g W )^ 

fc=i 

A 

argmin^ (-JJ («<*>) E 

V ' 9=1 V fc=l 
2 B / A 

argmin £ - ^\{vfyR^vf \ P(G € S 9 ) 



*A fe > p(G e e 9 ) 



(76) 



9=1 \ k=l 
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where Q = {Gi , ■ ■ ■ , G^b } is a specific Voronoi regions and Jl< fc) =E gW (g( fc ))*|Ge5, • To minimize the distortion 
measure, can be chosen by the eigenvector associated with the maximum eigenvalue of . Therefore we can 
obtain V = {Vi, . . . , V 2 b}. 

In general, the average distortion converges, but the minimum distance Sfs does not converge as iteration 
proceeds. Sfs increases during the first few step, and has tendency to increase as iteration proceeds but may oscillate 
slightly after some iteration [33]. In this case, as indicated in [33], we save all intermediate minimum distances 
during the iterations and at some fixed iteration number, we obtain the maximum of the minimum distances from 
the previous saved minimum distances. We also obtain the codebook that corresponds to the index that maximizes 
the minimum distance. 
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Figure 1: MIMO MAC model with CSIT and CSIR. 
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Figure 2: Channel model of the communication system with CSIT and CSIR. 
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Figure 3: Equivalent channel model of the communication system with CSIT and CSIR. 
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Figure 4: Capacity region for MIMO MAC according to the cardinality of U. 
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Figure 5: Sum-rate capacity of a (2,2,4) system using a covariance codebook under a sum power constraint. 
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Figure 6: Sum-rate capacity of a (5,3,3) system using an eigenbeamforming codebook under a sum power constraint. 
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Figure 7: Sum-rate capacity of a (2,2,3) system using a Grassmannian beamforming codebook and random beam- 
forming codebook with random power allocation. 
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Figure 8: Sum-rate capacity of (2,2,3) systems using Grassmannian beamforming and statistical beamforming. 



K = 2, M = 2, M f = 4 (2 bits) 
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Figure 9: Sum-rate of (2,2,4) systems for the covariance codebook, the eigenbeamforming codebook, and the Grass- 
mannian beamforming codebook. 



24 




25 



